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Abstract 

The evidence on the cost and cost-effectiveness of global training programs is sparse. This manager's guide to cost- 
effectiveness analysis (CEA) is for professionals who want to recognize and support high quality CEA. It focuses on 
CEA of training in the context of program implementation or rapid program expansion. Cost analysis provides cost 
per output and CEA provides cost per outcome. The distinction between these two analyses is essential for making 
good decisions about value. A hypothetical example of a cost analysis compares the cost per trainee of a 
computer-based anti-retroviral therapy (ART) training to a more intensive ART training. In a CEA of the same 
example, cost per trainee who met ART clinical performance standards is compared. The cost analysis is misleading 
when the effectiveness differs across trainings. Two additional hypothetical examples progress from simple to more 
complex costs and from a narrow to a broader scope: 1) CEA of the cost per ART patient with 95% adherence that 
compares the performance of doctors to counselors who attend additional training, and 2) CEA of the cost per 
infant HIV infection averted for a Prevention of Mother to Child Transmission program that compares the current 
program to one with additional training. To create an evidence base on CEA of training, more well-designed 
analyses and data on the cost of training are needed. Analysts should understand more about how capacity is built, 
how quality is improved within a health facility, and the costs associated with them. Considering the life of an 
investment in training, evaluations are needed on how many trainees apply the skills taught, how long trainees 
continue to apply them, and how long the content of the training conforms to national or international guidelines. 
Better data on effectiveness of training is also needed. It is feasible to measure effectiveness by clinical performance 
standards, or intermediate outcomes and coverage. Intermediate outcomes and coverage can also be combined 
with published estimates on health outcomes. 
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Background 

The global response to the HIV epidemic is one of the lar- 
gest public expenditures to fight a single disease in history 
[1,2]. This scaled-up response to the HIV epidemic re- 
quired large numbers of doctors, allied health profes- 
sionals, and administrative support staff with new, specific 
HIV clinical and management skills. Recognizing this 
need, governments, non-governmental organizations, and 
other international organizations invested heavily in HIV 
training of health care providers in Africa, Asia, and Latin 
America. For example, between 2004-2009, as part of the 
President's Emergency Plan for AIDS Relief [3] 213,200 
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health care providers were trained in Prevention of Mater- 
nal to Child Transmission (PMTCT) and 304,700 were 
trained in anti-retroviral therapy (ART). 

Global programs for HIV are now moving from emer- 
gency response to address sustainability, task-shifting, and 
integrating HIV care and treatment into primary health 
care and chronic disease management. This transition will 
likely involve continuing major investments in training 
[4,5], and program managers will be looking for good 
value for these investments. Cost-effectiveness analysis 
(CEA) is a powerful method to identify value, but many of 
the well-established methods for conducting these ana- 
lyses for clinical trials, demonstration projects, and other 
research have not been applied to scaling-up interventions 
and the training programs that support it. A notable ex- 
ception is the WHO Choice Project that estimated the 
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cost-effectiveness of interventions that would contribute 
to achieving the Millennium Development Goals [6]. 

Program managers will find evidence is sparse on the 
cost-effectiveness of global training programs in general 
[7] and HIV training programs in particular [8]. School- 
ing and training are investments, known as human capital 
[9]. CEA of global training to date have focused on how 
and who to train, as well as training as a component of a 
larger intervention. Analyses of how to train have 
addressed the most effective means of training a specific 
group of health care providers [10-13]. Analyses of who to 
train have addressed task-shifting or task-sharing in which 
training was extended to a group of health care providers 
who assumed new responsibilities for specific services 
[14-18]. Finally, some analyses have estimated the cost- 
effectiveness of interventions that included training for the 
health care providers who implemented them [19-21]. 

To create an evidence base on the CEA of training, pro- 
gram managers will need to deploy analytic resources 
wisely. This article has been written as a guide for pro- 
gram managers who may not be economists, but want to 
recognize and support high quality CEA of training. It fo- 
cuses on the approaches and challenges associated with 
conducting CEA of training in the context of program 
implementation or rapid expansion of programs. For a 
general consumers guide, please see the Panel on Cost- 
Effectiveness in Health and Medicine's book [22] or arti- 
cles [23-25]. The National Library of Medicine offers a 
free, less technical resource in its online course "Health 
Economics Information Resources: A Self-Study Course", 
which focuses on identifying CEA studies, and appraising 
their quality [26]. For professionals who plan to conduct 
CEA, Drummond et al. [27] is a well-respected introduc- 
tion. In addition, UNAIDS [28] created guidelines with in- 
structions for conducting cost analyses of HIV prevention 
strategies that can be extended to other HIV programs 
such as training. These excellent resources, however, pre- 
date the scale-up of HIV treatment and care and are ori- 
ented to trials, demonstration projects, and other research. 

This manager's guide begins with definitions of cost 
analysis and CEA. Understanding the distinction between 
these two analyses is essential for making good decisions 
about value. Then, three hypothetical examples of CEA of 
training programs are presented: 1) cost per trainee who 
met ART clinical performance standards; 2) cost per pa- 
tient with 95% ART adherence; and 3) cost per HIV infec- 
tion averted. Each example provides insights on both 
measures of cost and effectiveness that would contribute 
to a CEA in the context of program scale-up. 

Cost analysis 

A cost analysis estimates the cost per unit of output, 
where costs are the value of all inputs that a program 
uses. The inputs typically consist of the time of trainers 



and trainees, supplies, teaching materials, and possibly 
equipment, facility space and transportation. Consider a 
simple hypothetical example in which a program manager 
is planning to scale-up ART services at a clinic. S/he com- 
pares two trainings to upgrade the skills of 25 clinical staff 
in monitoring patients on ART. One is a computer-based 
training followed by a three-day practical workshop. The 
second is an intensive, two-week workshop followed by 
two on-site trainings. Table 1 presents the cost for the two 
programs in three categories: 1) training program budget, 
2) training venue contract, and 3) ministry of health con- 
tribution. For the personnel costs in the training program 
budget, the remuneration rate, which includes salary and 
fringe benefits, is multiplied by the number of units (e.g., 
hours, days, months). The subtotal, which is the sum of 
the cost for each person, is $7,350 for the computer-based 
training, and $12,250 for the intensive training. 

A cost analysis can differ from a training program 
budget for at least two reasons: 1) multiple partners con- 
tribute to the training, and 2) some contributions are 
"in-kind." Training programs are often funded through a 
combination of contributions by donors, the ministry of 
health, and the trainees. In Table 1, the cost also includes 
a training venue contract funded by a donor, and the min- 
istry of health's contributions. Each partner has a "perspec- 
tive" and a cost analysis conducted from the perspective of 
a single partner would focus only on that partner's budget. 
A cost analysis conducted from the societal perspective in- 
cludes the contributions of all the partners as well as 
trainees and patients. In Table 1, the total societal cost is 
$12,025 for the computer-based training, and $20,000 for 
the intensive training. 

Some professional guidelines [22,23], recommend that 
analysts report the cost analysis from societal perspective 
as a reference case so that costs are comparable across 
analyses. However, cost analyses could be reported from 
additional perspectives as appropriate. Program managers 
should expect analysts to identify the perspective of the 
analysis and acknowledge that some costs may not be in- 
cluded whenever the cost analysis is not conducted from 
the societal perspective. 

Partners may contribute in-kind as well as with pro- 
gram budgets. In the example in Table 1, the ministry of 
health contributes the trainees' time, which should be 
included in a cost analysis from a societal perspective 
even if their participation did not require an extra pay- 
ment to the trainees. The trainees would have engaged 
in productive work had they not attended the training, 
which is the opportunity cost of trainees' time. The op- 
portunity cost is the value of the most beneficial alterna- 
tive feasible use of the resources. Please see the Glossary 
in Table 2 for definitions of economic terms used in this 
manager's guide. This opportunity cost of the trainee's 
time is valued at the trainees' remuneration rate, which 
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Table 1 Cost analysis of a computer-based training to an intensive training 



Computer-based training 
and three-day workshop 



Intensive two-week workshop 
and two on-site trainings 



Training program budget 

Curriculum designer 
Subject matter experts 
Trainer 

Materials: participant manuals 
On-site training 
Subtotal training program 
Training venue contract 

Rental 

Meals and tea break 
Subtotal training venue 
Ministry of health contribution 

Trainees' time computer-based course 
Trainees' time workshop 
Trainees' time on-site training 
Subtotal ministry of health 
Total societal cost 
Cost analysis 
Number of trainees 
Cost per trainee 



Cost per unit 

$2,500/month 

$200/hour 

$100/day 

$10/person 

$1,000/site 



$100/day 
$5/day 



$20/day 
$20/day 
$20/day 



Units 

2 
9 
3 

25 
0 



3 

75 



125 
75 



Cost* 

$5,000 
$1,800 



$250 

$7,350 

$300 
$375 
$675 

$2,500 
$1,500 
0 

$4,000 
$12,025 

25 

1 2025/25= 



Units 

2 
5 

10 

25 
5 



10 
250 



250 
25 



Cost* 

$5,000 

$1,000 

$1,000 

$250 

$5,000 

$12,250 

$1,000 
$1,250 
$2,250 



$5,000 
$500 
$5,500 
$20,000 

25 

20,000/25= 



*To calculate each cost, multiply the cost per unit by the number of units. The subtotal is the sum of all the costs in the category. 



is $20 per person per day in this example. In general, an 
average salary rate for each trainees' profession, gender 
and age group is used in the calculation; detailed data 
on each person's salary are not necessary. 

For the cost analysis, the total societal cost is divided 
by the number of outputs. For training activities, the 
output produced is typically the number of people 
trained. In this example, the cost per trainee is $481 for 
the computer-based training program, and $800 for the 
intensive training. Program managers should, however, 
be wary of cost per unit of output. In routine reporting, 
someone who attended a one-hour lecture might be 
counted the same way as someone who completed a 
one-year fellowship, i.e., as a "person trained". Be- 
cause of the large difference in resources required 
and presumably the skills enhancement achieved, an 
analysis that simply compared the cost per trainee 
would be misleading. A CEA that measures the cost 
per outcome can address differences in effectiveness 
across trainings. 

Cost-effectiveness analysis (CEA) 

As applied to health and medicine, a CEA estimates the 
cost per unit of health outcome such as an HIV 



infection averted or a year of life gained. The fewer dol- 
lars required to achieve an outcome, the more cost- 
effective the intervention is considered to be. For ex- 
ample, an adult male circumcision program that costs 
$500 per HIV infection averted is more cost-effective 
than a voluntary counseling and testing program that 
costs $5,000 per HIV infection averted. 

The scope of a CEA is determined by the denominator; 
only programs with a common denominator can be com- 
pared. For CEA with the broadest scope, the denominator 
is units of life measured by a combination of mortality and 
morbidity. Two widely used measures are: QALYs and 
DALYs. Both measures account for years of life gained 
from reduced mortality, and improved quality of life dur- 
ing years of reduced morbidity. Both measures also have 
weights for years of reduced morbidity ranging from zero 
to one, but the similarities end there. For example, QALYs 
measure quality of life where death is zero and full health 
is one, whereas DALYs measure disability where zero is 
full health and one is death. The measures also differ in 
objectives, how units of life are characterized, and the 
methods for calculating the weights associated with each 
characteristic. Gold et al. provide an excellent comparison 
between the two measures [29]. 
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Table 2 Glossary of cost and cost-effectiveness terms 



Annuitization 



Capital Cost 



Cost analysis 



Cost-effectiveness analysis 
(CEA) 



Cost effectiveness ratio 

Disability Adjusted Life Years 
(DALY) 

Dominance 

Incremental Cost Effectiveness 
Ratio (ICER) 

Opportunity Cost 



Perspective 



Quality Adjusted Life Year 
(QALY) 



Remuneration 
Sensitivity analysis 



Method of allocating the cost of an investment (i.e. a capital cost) over the time period when it is used. When 
discounting is ignored, annuitization is calculated as the cost of investment divided by the number of years of 
life of investment. 

It is an investment in an asset such as buildings, land, vehicles or equipment that is used over more than one year. 
The investment is generally a single purchase that may precede the project, so that its cost is not always included in 
the project budget. The asset has an opportunity cost and its annual cost call be allocated overtime. 

Estimate of the cost per unit of output, where outputs are the activities or services, such as health care providers 
trained or patients treated. 

Analysis of the cost per unit of outcome. The outcome serves as the denominator and must be the same for 
interventions and programs that are compared. CEA of health and medicine, are generally conducted with 
health outcomes. 

The ratio of cost to outcomes. When two programs are not explicitly compared, the ratio represents the cost- 
effectiveness of the program of interest relative to doing nothing. 

A measure of the burden of disease of a population in terms of years lost due to ill-health or death. Years of life 
are weighted from zero to one where zero represents full health and one represents death. Health is 
characterized by disease categories, and the weights associated with diseases are determined by expert opinion. 

An intervention or program with a lower cost and better outcomes than the alternative. 

The ratio of the difference in cost between two programs and the difference in their effectiveness. The ratio 
represents the additional cost associated with each additional unit of outcome. 

The value of the most beneficial alternative feasible use of resources for an activity. For goods and services that are 
purchased in a competitive market, the opportunity cost is simply the price. Goods and services that are not 
purchased such as volunteer time should be valued at the cost of purchasing them. Similarly, for goods or services 
that are subsidized or taxed, they should also be valued at cost to purchase them without the subsidy or tax. 

The point of view from which costs are calculated. Six potential perspectives for a cost analysis of training are: 
1) Program perspective might simply be the program budget, 2) Donor perspective would include the budgets 
of all programs that contribute to an output or outcome, 3) Provider perspective represents the costs of the 
health care system, including ministry of health, hospitals and clinics, 4) Trainee perspective might be earnings 
from private practice foregone while attending training, as well as tuition, 5) Patient perspective includes the 
out-of-pocket expenditures for health care and the time devoted to care for themselves or family members. 6) 
Societal perspective represents all costs regardless of who bears them including: programs, donors, providers, 
trainees, and providers. 

A measure of health of a sample in terms of quality of life years of life lost due to ill-health or death. Years of 
life are weighted from zero to one where zero represents death or an equivalent state, and one represents full. 
Health is characterized by health states such as the ability to walk a mile and the weights associated with health 
states are reported by patients or the community through various research methods. 

The total amount of resources a consultant or employee receives including salary and fringe benefits. 

Calculation of alternative cost-effectiveness results when there is uncertainty about one or more parameters that 
measure costs or effects. Sensitivity analysis is generally incorporated in CEA that are deterministic, meaning the 
result is a point estimate. It helps to identify the extent to which uncertainty about a parameter would 
substantially affect the estimate. 



As a practical matter, program managers rarely have 
time or funding to support a CEA that measures the 
specific contribution of training to health outcomes. For- 
tunately, an intermediate measure, such as the number 
of health care providers that perform a task competently, 
or an intermediate outcome such as the number of pa- 
tients who adhere to treatment may be an appropriate 
denominator for some analyses. It may also be possible 
to collect original data on an intermediate measure and 
use published estimates to calculate the health out- 
comes. These three options are presented in three hypo- 
thetical examples below. 

Intermediate measure 

Continue with the hypothetical example above in which 
the computer-based ART training and intensive ART 



training are compared. The program manager monitors 
a comprehensive set of costs that extend beyond the 
training events to include the cost of transfer of learning. 
As shown in Table 3, the total societal cost of the 
computer-based training is $12,025 and of the intensive 
training is $20,000 as in Table 1. The cost analysis in 
Table 3 also includes the time senior staff spent with 
graduates after the training to support them to apply 
their new skills, such as ad hoc sessions in the context 
of actual patient visits. This cost of the supervisors' time 
in providing this additional support is $8,000 among 
graduates of the computer-based training versus $2,000 
among graduates of the intensive training. The total cost 
of the training and transfer of learning is $20,025 for the 
computer-based training and $22,000 for the intensive 
training. 
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The program manager selects a set of tasks to measure 
clinical performance to compare the effects of the train- 
ings. A graduate who performs 80% of the tasks correctly 
meets the standard. In spite of post-training support, only 
15 graduates of the computer-based training meet the 
standard, whereas 22 graduates of the intensive training 
do. Each training is compared to no training, i.e., doing 
nothing, so the cost-effectiveness ratio is simply the total 
societal cost divided by the number of trainees who meet 
the standard. As shown in Table 3, the cost per success- 
fully trained graduate of the computer-based training is 
$1,335 versus $1,000 for the intensive training. 

The key to this result is collecting cost data on all the 
activities associated with transfer of learning and meas- 
uring effectiveness in terms of clinical performance. If 
success was measured simply by the number of trainees 
as in Table 1, the lower cost per graduate might displace 
competence as the standard for selecting a training. 

Intermediate health outcomes 

Intermediate health outcomes are used in a CEA with a 
somewhat broader scope. Consider an agency that is 
committed to providing ART to HIV-infected adults and 
children. Since the health benefits of ART are well- 
documented [30-33], a program manager might want to 
focus on extending coverage and improving adherence. 
The program manager's question in this instance is 
"How can I allocate my budget to provide high quality 

Table 3 CEA with an intermediate outcome: cost per 
trainee who meets ART clinical performance standard 

Computer-based Intensive two-week 

training and three-day workshop and two 

workshop on-site trainings 

Cost of transfer 
of learning* 

Cost of training $12,025 $20,000 

Cost of follow-up $8,000 $2,000 

support by supervisors 

Total cost of transfer $20,025 $22,000 
of learning 

Cost analysis 

Trainees 25 



Cost per trainee 

Cost-effectiveness 
analysis 

Trainees who meets 
ART clinical performance 
standard** 

Cost per trainee who 
meet ART clinical 
performance standard 



$20,025/25 = $801 



25 

$22,000/25 = $880 



15 



$20,025/12 = $1335 



22 



$22,000/23 = $1000 



*Transfer of learning includes both the training events and follow-up support. 
**The ART clinical performance standard is to perform 80% of the task correctly. 
According to this measure, the computer-based training was less effective. 



care to the most patients?" This broader scope supports 
comparison of training programs to other activities that 
may affect coverage and adherence, such as pharmacy 
logistics, continuous quality improvement, or leadership 
initiatives. 

In this hypothetical example (Table 4), a clinic is pro- 
viding ART in an impoverished urban setting where 
many patients have substance abuse problems, or other 
challenges to adherence. While good adherence is not a 
health outcome, studies showed that the correlation be- 
tween good adherence and viral suppression is high 
[34-38]. The program manager adopts an intermediate 
outcome; the number of patients maintaining 95% ad- 
herence. Some experts argue that setting a high standard 
for adherence is discouraging to patients, and alternative 
levels such as 80% or simply mean adherence among pa- 
tients could also be used in an analysis [35]. 

Prior to training, relatively highly-paid doctors spend 
much of their time screening patients at risk for poor 
adherence, counseling them, and referring them for add- 
itional support. As shown in the Pre-training column of 
Table 4, ART services cost $150,000 and served 400 pa- 
tients each year. Adherence is 95% among 360 patients 
(90%) at a cost of $417 per patient with 95% adherence. 

The program manager sees an opportunity to increase 
coverage through task-shifting or task-sharing and funded 
training for counselors to assume responsibility for the 
screening, counseling, and referral activities. In this ex- 
ample, as the measure of effectiveness shifts from trainees 
to patients, the benefits of an investment in training last 
several years when trained staff continue to apply their 
new skills. The annual measures of patient outcomes are 
compared to the annual cost of the investment in training. 
Distributing the cost of an investment over time is called 
"annuitization." Just as the use of a $40,000 automobile 
can extend for 10 years at a cost of $4,000 per year, the 
total cost of training, say $20,000 in this example, that ex- 
tends for four years is $5,000 per year (for simplicity, 
discounting is ignored in these examples.) The annual cost 
depends on how many trainees apply the skills learned, 
how long they apply them, and how long the new skills re- 
main the standard of care. For example, Hiner et al. 
reported that 65% of trainees provided voluntary counsel- 
ing and testing in the Caribbean three years after training 
on these services [39] . Namagembe et al. reported that im- 
proved clinical practice persisted for at least one year after 
a malaria case management training program [40]. Re- 
search in the United States showed that 50% of practice 
guidelines were outdated in 5.8 years [41]. 

As shown in the Post-training column, the annual 
training cost is $5,000. There are other changes in cost 
after the training. Personnel costs decrease from $50,000 
to $30,000 as doctors with high salaries are replaced by 
counselors. The trained counselors move patients 
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Table 4 CEA with an intermediate health outcome: cost 
per patient with 95% ART adherence 



Program cost 

Remuneration 

Medication 

Total program cost 

Cost of training (annuitized)* 

Total cost 

Cost-effectiveness analysis 

Number of patients 

Percentage of patients with 95% 
ART adherence 

Number of patients with 95% 
ART adherence 

Cost-effectiveness result 



Pre-training Post-training 



$50,000 $30,000 

$100,000 $110,000 

$150,000 $140,000 

$0 $5,000 

$150,000 145,000 

400 440 

90% 85% 

360 374 

Dominates" 



The annual cost of a $20,000 training with a four-year life of investment 
is $5,000. 

**No cost-effectiveness ratio is necessary, because a program with lower cost 
and higher effectiveness dominates the alternative. 

through the ART screening, counseling, and referral 
process more quickly, which increases the number of pa- 
tients on ART from 400 to 440. Some of the savings in 
personnel costs are offset by the cost of medications for 
40 additional patients. Total program cost decreases from 
$150,000 to $140,000, which would not be the case if the 
total cost of training were allocated to the first year. 

The quality of the new screening, counseling, and re- 
ferral activities is, however, lower than before the train- 
ing; the counselors are less effective than doctors. 
Adherence is 95% for 374 of 440 patients (85%). Never- 
theless, the expanded coverage means that more patients 
achieve 95% adherence post training than before. The 
training dominates the alternative, because the total cost 
is lower and number of patients with 95% adherence is 
higher post training than before. The key to this result is 
tracking service volume to show the training is more cost- 
effective than if the CEA focused only on adherence. 

Health outcomes 

The hypothetical example in Table 5 combines data on 
coverage with published estimates of the health out- 
comes associated with PMTCT. Before an intervention 
is scaled-up in HIV care, there is generally extensive re- 
search on its effectiveness. It is neither feasible nor ne- 
cessary for each training to replicate the earlier research. 
It is sometimes possible to apply the results of earlier 
research to estimate the effects of training on health out- 
comes. The CEA Registry is a good resource for identify- 
ing previous research on cost-effectiveness [42]. 

Even the best research, however, may not provide a 
single estimate of costs or effects. Results from a single 



study are reported as a mean and confidence interval, 
and results may not be identical across multiple studies. 
When there is uncertainty about parameter estimates, 
analysts conduct a sensitivity analysis with a base case 
and alternative estimates that show a range of cost- 
effectiveness ratios. Uncertainty may exist for a variety 
of reasons and this example demonstrates a sensitivity 
analysis for estimates of health outcomes. 

Considering PMTCT, HIV is transmitted during ante- 
natal, delivery, and breastfeeding periods, but it is not 
possible to identify precisely the transmission associated 
with each period with available HIV testing methods. 
Research in the 1990s showed that, in the absence of 
treatment, HIV transmission in the antenatal or intra- 
partum period ranged from 19% to 30% and transmis- 
sion during breastfeeding ranged from 10% to 16% [43]. 
More precise estimates may never exist, because the 
earlier studies proved that treatments were effective 
and it would now be unethical to withhold treatment. 
Consequently, a CEA would present a sensitivity analysis 
of the effect of a PMTCT training on HIV infections 
averted. 

Begin with the cost analysis of the PMTCT program 
in a district hospital that cost $100,000 per year. The pro- 
gram manager wants to know if money spent on coun- 
selors' training is well spent. If so, s/he will seek funding 
to extend this training to other PMTCT sites. Before the 
training, costs are apportioned across personnel, medica- 
tions and capital categories as shown in Table 5. Personnel 
costs are calculated in two categories: 1) clinic staff, in- 
cluding counselors, and 2) supervisory staff. For clinic 
staff, the number of full-time equivalent (FTE) staff pro- 
viding counseling, HIV testing, and ART screening and 
treatment is multiplied by their remuneration rate per 
FTE for a total of $65,000. For supervisory staff, the por- 
tion of their time spent supporting PMTCT is multiplied 
by their remuneration rate for a total of $15,000. For sup- 
plies, $15,000 is spent on HIV test kits, ARV drugs, and 
other supplies. Capital costs are calculated for three cat- 
egories, each annuitized to an annual cost: 1) transporta- 
tion is $3,000, 2) equipment such as refrigerators, 
computers and furniture is $500, and 3) building is $1,500. 
The ministry of health provides the hospital building used 
for PMTCT free-of-charge. Nevertheless, absent PMTCT, 
the space could be used for other worthwhile activities. Its 
opportunity cost is approximated by the annual rent for 
equivalent space if procured on the market. 

For the pre-training effectiveness, the program serves 
1,000 women and infant pairs per year who complete 
the ARV regimen. The number of infant HIV infections 
averted each year is estimated by multiplying the num- 
ber of women and infant pairs by the published ante- 
natal and intrapartum transmission rates [43] and 
published estimate of 63% efficacy for the PMTCT 
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Table 5 CEA with a health outcome: cost per HIV 
infection averted 

Pre-training Post-training 



Program cost 






Remuneration 






Clinical staff, including 
counselors 


$65,000 


$72,000 


Supervisory staff 


$15,000 


$12,000 


Tnta rpm I inpratinn 


<sn 000 


< i84 000 


Supplies, including HIV 
test kits and ARV drugs 


$15,000 


$ 1 8,000 


Capital (annuitized) 






Vehicle 


$3,000 


$3,000 


Equipment 


$500 


$500 


Building 


$1,500 


$1,500 


Training 


$0 


$5,000 


Total Capital 


$5,000 


$10,000 


Total program cost 


$100,000 


$112,000 


Estimate of effectiveness 






Number of mother infant 

mirr D (\ ATI T 

pdl [S LridL rlvl I L I 


1000 


1200 


Estimated vertical 
HIV transmission before 
and at birth* 






Base case 


25% 


25% 


Lower bound 


19% 


19% 


Upper bound 


30% 


30% 


Effectiveness of regimen 
for mothers and infant 


63% 


63% 


Estimated HIV 
infections averted 






Base case 


(1000*25*63) =158 


(1000*25- 


Lower bound 


120 


144 


Upper bound 


189 


227 



Cost-effectiveness analysis 

Incremental cost ($1 12,000-$ 100,000) = $12,000 



Incremental HIV 
infection averted 

Base case (189-158) = 31 

Lower bound (144-120) = 24 

Upper bound (227-189) = 38 

Incremental cost-effectiveness 
ratio (ICER) 

Base case ($1 2,000/31 )=$283 

Lower bound $215 

Upper bound $340 

*The effect of the training on MTCT is uncertain because there is a range of 
estimates for vertical HIV transmission before and during birth. The midpoint 
of the range is used to estimate effectiveness for the base case, and a 
sensitivity analysis is conducted with the lower and upper bounds. The base 
case and range are also reported for the number of HIV infections averted 
and ICER. 



regimen provided at the clinic [44]. For the antenatal 
and intrapartum transmission rates, the base case uses 
the midpoint of the range of estimates (25%), and the 
sensitivity analysis uses the lower (19%) and upper (30%) 
bounds. As shown in Table 5, the base case estimate of 
the number of HIV infections averted is 158 with a 
range from 120 to 189. 

Post-training, the cost changes in important ways. Be- 
cause the counseling protocol requires longer counseling 
sessions and smaller group sizes, the personnel cost of 
clinical staff, including counselors, increases from 
$65,000 to $72,000 annually. The training includes rou- 
tine record keeping, however, and allows senior nurses 
to take on supervisory functions formerly left to more 
highly paid supervisors. The result is a reduction in 
personnel costs of supervisors from $15,000 to $12,000 
per year. The cost of supplies increases from $15,000 to 
$17,000, because more women and infants complete the 
PMTCT sequence and consequently use test kits and 
ARV drugs. The training program cost $20,000 and it 
is estimated to have four years of benefit before skills 
degrade or staff members leave, with an annual cost of 
$5,000 per year. 

For the post-training effectiveness, the number of 
women and infant pairs who complete the PMTCT regi- 
men increases to 1,200. The base case estimate of the 
number of HIV infections averted is 189 with a range 
from 144 to 227. Both cost and HIV infections averted 
increased. The incremental cost-effectiveness ratio is the 
increase in total cost ($112,000 - $100,000) divided by 
the increase in infections averted (189 - 158), which is 
$283 per HIV infection averted with a range from $215 
to $340. 

Conclusions 

The cost data included in a cost analysis depend on its 
perspective. Some professional guidelines recommend 
that published cost analysis report the societal perspec- 
tive, which include the cost of all partners, as well as 
trainees and patients. Cost analyses can, however, be 
misleading when the effectiveness of the trainings differ. 

A CEA can guide program managers to make the best 
investments in training. The three hypothetical examples 
progressed from simple to complex costs and a narrow 
to broader scope to highlight key concepts about meas- 
uring the cost and effects of training in the context of 
program implementation or rapid expansion. 

To create an evidence base on CEA of training, the ex- 
amples in this manager's guide demonstrate the need 
for more well-designed analyses and data on the cost of 
training. Analysts should understand more about how 
capacity is built, how quality is improved within a health 
facility, and the costs associated with them. The analyses 
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can then collect data on how the cost of capacity- 
building and quality improvement change in response 
to training. Considering the life of an investment in 
training, analysts should focus on how many trainees 
apply skills taught during the training, how long 
trainees continue to apply them, and how long the 
content of the training conforms to national or inter- 
national guidelines. 

The examples also demonstrate the need for better 
data on effectiveness of training programs. It is feasible 
to conduct CEA of training in which effectiveness is 
measured by clinical performance standards, or inter- 
mediate outcomes and coverage. Intermediate outcomes 
and coverage can also be combined with published 
estimates on health outcomes to estimate the effect of 
training on health outcomes. Program managers are 
encouraged to maintain a focus on these effectiveness 
measures rather than outputs and to invest in trainings 
with the lowest cost per improvement in them. 

Authors' contributions 

GO led manuscript conceptualization and outline, conducted literature 
review, and edited multiple manuscript iterations including contributing 
original text. EM provided substantial edits and contributed original text. MW 
wrote early drafts and substantial edits, and reviewed final manuscript. All 
authors read and approved the final manuscript. 

Sources of support 

This study and the activities detailed were developed and conducted by the 
University of Washington and l-TECH with funding from Cooperative 
Agreement U91HA06801 -06-00 from the US Department of Health and 
Human Services, Health Resources and Services Administration (HRSA). 

Author details 

'Department of Global Health, International Training and Education Center 
for Health, University of Washington, 901 Boren, Suite 1 100, Seattle, WA, USA. 
2 Health Strategies International, 555 59th Street, Oakland, CA 94609, USA. 

Received: 28 July 2012 Accepted: 19 April 2013 
Published: 20 May 2013 

References 

1. Joint United Nations Program on HIV/AIDS (UNAIDS), Global Report: UNAIDS 
Report on the Global AIDS Epidemic, 2012. Available online at: http://www. 
unaids.org/en/media/unaids/contentassets/documents/epidemiology/2012/ 
gr2012/20121 120_UNAIDS_Global_Report_2012_en.pdf. Accessed on 

May 28, 2013. 

2. Kendall AE: U.S. Response to the Global Threat ofHIV/AIDS. Basic Facts. 
Congressional Research Service Repor; 2012. http://www.fas.org/sgp/crs/ 
misc/R41 645.pdf. 

3. The United States President's Emergency Plan for AIDS Relief: Capacity-building 
results [http://www.pepfar.gOv/press/sixth_annual_report/l 37144.htm] 

4. Kinfu Y, Dal Poz MR, Mercer H, Evans D: The Health worker shortage in 
Africa: are enough physicians and nurses being trained? Bull WHO 2009, 
87:225-230. 

5. The United States Government Global Health Strategy: http://www.ghi.gov/ 
resources/strategies/1 591 50.htm. Accessed on May 28, 2013. 

6. Evans D, Tan-Torres Edejer T, Adam T, Lim S: WHO Choosing Interventions 
that are Cost Effective (CHOICE) Millennium Development Goals Team. 
Achieving the millennium development goals for health: Methods to 
assess the costs and health effects of interventions for improving health 
in developing countries. BMJ 2005, 331 :1 1 37-1 140. 

7. Brown CA, Belfield CR, Field SJ: Cost effectiveness of continuing 
professional development in health care: a critical review of the 
evidence. BMJ 2002, 324:652-655. 



8. McCarthy E, O'Brien M, Rodriguez W: Training and HIV-treatment scale-up: 
establishing an implementation research agenda. PLoS Med 2006, 3:e304. 

9. Becker G: Human Capital. Chicago: University of Chicago Press; 1993. 

10. Walker D, McDermott JM, Fox-Rushby J, Tanjung M, Nadjib M, Widiatmoko 
D, Achadi E: An economic analysis of midwifery training programmes in 
South Kalimantan, Indonesia. Bull World Health Organ 2002, 80:47-55. 

1 1 . Harlow KC, Sportsman S: An economic analysis of patient simulators 
clinical training in nursing education. Nurs Econ 2007, 25:24-29. 

12. Arreola-Risa C, Mock C, Herrera-Escamilla AJ, Contreras 1, Vargas J: Cost- 
effectiveness and benefit of alternatives to improve training for 
prehospital trauma care in Mexico. Prehosp Disaster Med 2004, 19:318-325. 

13. Fairall L, Bachmann MO, Zwarenstein M, Bateman ED, Niessen LW, 
Lombard C, Majara B, English R, Bheekie A, van Rensburg D, et al: Cost- 
effectiveness of educational outreach to primary care nurses to 
increase tuberculosis case detection and improve respiratory care: 
economic evaluation alongside a randomised trial. Trop Med Int 
Health 2010, 15:277-286. 

14. Hounton SH, Newlands D, Meda N, De Brouwere V: A cost-effectiveness 
study of caesarean-section deliveries by clinical officers, general 
practitioners and obstetricians in Burkina Faso. Human Resources for 
Health 2009, 7:34. 

15. Clark KA, Mitchell EH, Aboagye PK: Return on investment for essential 
obstetric care training in Ghana: do trained public sector midwives 
deliver postabortion care? J Midwifery Womens Health 2010, 55:153-161. 

1 6. Reynolds HW, Toroitich-Ruto C, Nasution M, Beaston-Blaakman A, Janowitz B: 
Effectiveness of training supervisors to improve reproductive health quality 
of care: a cluster-randomized trial in Kenya. Health Policy Plan 2008, 23:56-66. 

1 7. Goodman CA, Mutemi WM, Baya EK, Willetts A, Marsh V: The cost- 
effectiveness of improving malaria home management: shopkeeper 
training in rural Kenya. Health Policy Plan 2006, 21:275-288. 

18. Sanders J: A family medicine training program in the Republic of 
Georgia: incorporating a model of chronic disease management. J Am 
Board Earn Med 2007, 20:557-564. 

19. Adam T, Manzi F: Armstrong Schellenberg J, Mgalula L, de Savigny D, 
Evans DB: Does the integrated management of childhood illness cost 
more than routine care? Results from the United Republic of Tanzania. 
Bull World Health Organ 2005, 83:369-377. 

20. Armstrong Schellenberg JRM, Adam T, Mshinda H, Masanja H, Kabadi G, 
Mukasa O, Theopista J, Sosthenes C, Nathan R, Wilczynska K, et al: 
Effectiveness and cost of facility-based Integrated Management of 
Childhood Illness (IMCI) in Tanzania. Lancet 2004, 364:1583-1594. 

21. Harrison A, Karim SA, Floyd K, Lombard C, Lurie M, Ntuli N, Wilkinson D: 
Syndrome packets and health worker training improve sexually 
transmitted disease case management in rural South Africa: randomized 
controlled trial. AIDS 2000, 14:2769-2779. 

22. Gold M, Siege J, Russell L, Weinstein M: (Eds): Cost-Effectiveness in Health 
and Medicine. Oxford: Oxford University Press; 1996. 

23. Siegel J, Weinstein M, Russell L, Gold M: Panel on cost-effectiveness in 
health and medicine: recommendations for reporting cost-effectiveness 
analyses. JAMA 1996, 276:1339-1341. 

24. Weinstein M, Siegel J, Gold M, Kamlet M, Russell L: Recommendations of 
the panel on cost-effectiveness in health and medicine. JAMA 1996, 
276:1253-1258. 

25. Russell L, Gold M, Siegel J, Daniels N, Weinstein M: The role of cost- 
effectiveness analysis in health and medicine. Panel on cost-effectiveness in 
Health and Medicine. JAMA 1 996, 276:1 1 72-1 1 77. 

26. Health Economics Information Resources: A Self-Study Course. 
http://www.nlm.nih.gov/nichsr/edu/healthecon/index.html. 

27. Drummond M, Sculpher M, Torrance G, O'Brien B: Methods for the Economic 
Evaluation of Health Care Programmes. 3rd edition. Oxford: Oxford University 
Press; 2005. 

28. Joint United Nations Programme on HIV/AIDS: Costing Guidelines for HIV 
Prevention Strategies. Geneva, Switzerland; 2000 Available online at http:// 
data.unaids.org/Publications/IRC-pub05/JC412-CostGuidel_en.pdf. 

29. Gold M, Stevenson D, Fryback D: HALYS and QALYS and DALYS, OH MY: 
similarities and differences in summary measures of population health. 
Annu Rev Public Health 2002, 23:1 15-134. 

30. Hammer S, Squires K, Hughs M, Grimes J, Demeter L, Currier J, Eron J, 
Feinburg J, Balfour H, Dayton L, ef al: AIDS clinical trials group 320 study 
team: a controlled trial of two nucleoside analogues plus indinavir in 
person with human immunodeficiency virus infection and CD4 cell 



O'Malley et al. Human Resources for Health 2013, 11:20 
http://www.human-resources-health.eom/content/1 1 /1 /20 



Page 9 of 9 



counts of 200 per cubic millimeter or less. New England J Med 1997, 
337:725-733. 

31. Montaner J, Reiss P, Cooper D, Vella S, Harris M, Conway B, Wainberg M, 
Smith D, Robinson P, Hall D: INCAS study group: A randomized, double- 
blind trial comparing combinations of nevirapine, didanosine, and 
zidovudine for HIV-infected patients: the INCAS Trial: Italy, the 
Netherlands, Canada and Australia study. JAMA 1 998, 279:930-937. 

32. Palella F, Delaney K, Moorman A, Loveless M, Fuhrer J, Satten G, Aschman 
D, Holmberg S, et at. Declining morbidity and mortality among patients 
with advanced human immunodeficiency virus infection. New England J 
Med 1998, 338:853-860. 

33. The Antiretroviral Therapy in Lower Income Countries (ART-LINC) 
Collaboration and ART Cohort Collaboration (ART-CC) groups: Mortality of 
HIV-1 -infected patients in the first year of antiretroviral therapy: 
comparison between low-income and high-income countries. Lancet 
2006, 367:81 7-824. 

34. Lucas G: Antiretroviral adherence, drug resistance, viral fitness and HIV 
disease progression: a tangled web is woven. J Antimicrob Chemother 
2005, 55:413-416. 

35. Liu H: Mille rL, Hays R, Golin C, Wu T, Wenger N, Kaplan A: Repeated 
measures longitudinal analyses of HIV virologic response as a function 
of percent adherence, dose timing, genotypic sensitivity, and other 
factors. J Acgulr Immune Defic Syndr 2006, 41 :31 5-322. 

36. Chen L, Hoy J, Lewin S: Ten years of highly active antiretroviral therapy 
for HIV infection. Medical Journal of Australia 2007, 1 86:146-1 51 . 

37. Bangsberg D, Hecht F, Charlebois E, Zolopa A, Holodniy M, Sheiner L, 
Bamberger J, Chesney M, Moss A: Adherence to protease inhibitors, HIV-1 
viral load, and development of drug resistance in an indigent 
population. AIDS 2000, 14:357-366. 

38. Paterson D, Swindells S, Mohr J, Brester M, Vergis E, Squier C, Wagener M, 
Singh N: Adherence to protease inhibitor therapy and outcomes in 
patients with HIV infection. Ann Intern Med 2000, 133:21-30. 

39. Hiner C, Mandel B, Weaver M, Bruce D, Lee P, McGaw B, McLaughlin R, 
Anderson J: Evaluation of a voluntary counseling and testing training 
program in the Caribbean region. Hum Resour Heal 2009, 7:1 1 . 

40. Namagembi A, Ssekabira U, Weaver M, Blum N, Burnett S, Dorsey G et al: 
Mpanga Sebuyira L, Ojaku A, Schneider G, Yeka A: Improved clinical 
skills after team-based, malaria case-management training of health care 
workers in Uganda. Malar J 2012, 11:44. 

41. Shekelle P, Ortiz E, Rhodes S, Morton S, Eccles M, Grimshaw J, Woolf S: 
Validity of agency for healthcare research and practice guidelines: how 
quickly do guidelines become outdated? JAMA 2001, 286:1461-1467. 

42. Center for the Evaluation of Value and Risk in Health: Cost Effectiveness 
Analysis Registry, [https://research.tufts-nenic.org/cear4/] 

43. Mira J, Denis AA: The cost-effectiveness of preventing mother-to-child 
transmission of HIV in low- and middle-income countries: systematic 
review. Cost Eff Resour Alloc 201 1 , 9:3. 

44. The Petra Study Team: Efficacy of three short-course regimens of 
zidovudine and lamivudine in preventing early and late transmission of 
HIV-1 from mother to child in Tanzania, South Africa, and Uganda (Petra 
study): a randomised, double-blind, placebo-controlled trial. Lancet 2002, 
359:1178-1186. 



doi:1 0.1 1 86/1 478-4491 -1 1 -20 

Cite this article as: O'Malley et al: Cost-effectiveness analyses of 
training: a manager's guide. Human Resources for Health 2013 11:20. 



f \ 

Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at /^'\ n! _, ul _-| r Q r,tr=l 

www.biomedcentral.com/submit ammBa central 



